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* ~~ The popularity of using qualitative, or ethnographic, research methods 
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to improve educational practices is increasing. ‘Hiker, an examination 
of how research gets into policy is necessary to assess accurately the ex- 

tent to which this qoal can be realized. This paper assesses the efficiency 
of four strategies’ for increasing research use in policy making and identi- a 
fies the ones nose amenable for use by qualitative researchers. After de- 


scribing these strategies, an example of an attempt to direct research to ‘ 


- 


policy makers is, provided. This example reveals additional difficulties 


qvalitative researchers face in the research to policy process. 
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"The use of participant-observation and qualitative interviewing to 
study education is rapidly piewacetng in popularity (Mulhauser, 1977; Rist, ‘ 
1980) . There is a growing ates as researchers and sponsors of 
~ research alike that the kind of knowledge these iP heie yield can serve as 


the base from which to develop improved educational practices. However,: 


‘ at the moment this sentiment springs more from wishful thinking than actual 


. 


v 
v 


experience. 
7 


a A long history of debate addresses the issue of how successfully ré- 
: ¢ . 
' search informs policy decisions. The fact that most who discuss this topic 


continue to propose ways to improve research utilization attests to the ‘ 


‘rather limited success so far. The use of tquatitative research in educa- 


‘ 


tion is‘in danger of becoming no more than a passing fad if too many un- 


me M ‘ ‘ 
founded and glowing claims are quickly dimmed by the realities of the world 


ey 


of policy making. Thus, it wants be useful at this juncture for qualita- 
tive researchers to examine the prospects of their research being used by 
policy makers and to adjust their expectations accordingly. e 
In this paper we eusacerre begin such a task. First, we identify 
four strategies for increasing the use of research (regardless of the 
methodological approach) in policy making and assess the deates at success 
these strategies are likely "4 have. We then select the strategies most 
available for use by researchers and develop guide nes for making sthne> 


graphic research useful to policy makers. Finally, to illustrate the com- 


; plexity of doing ethnographic research for this audfence, we provide an 


; 


example from our own work. 


revolves around a central issue. In this section we describe these issues 


in policy making contained in the research/knowledge utilization litera- 


: f ; 
ture. “These proposals emphasize two thentts: j the kind of research con- 


e 
. 


‘ducted and the dissemination ‘of: research to policy makers. -Bath theme 
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and use them to identify, four basic “strategies for improving fesearch use. 


We then, assess the ef ficiency’ of these strategies in promoting this end. 


” 


. id «a 
The central issue with respect, to the kind of research conducted is 


j . 


how the goals of research are defined. This issue ‘most clearly separates . 
baste from applied researchers and engenders the sabe dubete between pro- 
ponents of the two positions. Basic researchers destan shud) es which seel: 
to complete Gaps in or extend theory; applied ReeRerene ys ini studies 
which seek to provide information for the vetuctén of a specified problem. 
Weiss (1978) labels the qoal of the former kind of research as fenltght= 
enment'' and the latter as "'engineering'' (i.e., the research is-"engineered"! 


to address a particular problem). Kerlinger (1977) argues that although ee 


basic resenren does not directly address any specific policy concern, ‘its 


“impact derives from the slow but continuous accumulation of evidence whi ch 


eventual ly alters the ways in which policy makers view reality. lig the % Se 7 
other hand, applied researchers + mained that research’ dipectes toward . 
solving specific ei ie is most likely to ‘eet the information needs of ” 
policy makers and ‘hue ‘we weave its way into policy (Schubert, “1980). 
Discussions about the dissemination of research focus on the means by 
which research is communicated to policy makers. Zaltman (1979) identifies fags 
ote 


oe es * 


two such modes :. (1) "'knowhedge transfer! ,whi.ch is, esdenti gy a ‘one-way : 


. communi cat ion of* résearch re the producer to the user ‘and (2) "'knowledge 


. * “~~ a a? g * ° 
3 transaction!! which is an active exchange BotenA producers and users about 
. - ° p ¢ . ~ ~ . 
® . . s . . y ‘ -. e 
needed research. Knowl edge transfer is accomplished primarily through 
/@ - 04 . » e s = , + 
forms of mas s media, such as Peuenele, films, or lectures . Proposals re “| 


lated to knowledge ‘panehes winhse ties” the form and content of ‘the Knowl edge 
. het is presentéd cae and the probability of its use by a particular 
audience. (Eisner, 1979; Florio et al., 1979; House, °1979) Knowledge trans- 
5 action can Gccur through digzek Gonterewriond betweeir policy makers: and de 
' researches ‘about the design, cofduct, and rests. of studies (Cohen and : 


* » ls * 


-, “Garet, 1979; “Muthausecs 1974, 1977; Saks, 1980; Strike, 1979). Such direct, 


interaction: is most likely to Lake place. when.a study is commissioned by 


~ a 
« > 4 ° - : = . . zs é ‘ 


eg sorry! makers. Transaction can also be through human ‘intermediaries who 


help establish ‘Tesearch. agendas and eonmentbea te research ffnaings ne policy : 


ve aa 


: ~ makers. For-.examp fe ,~ Sundquist” (1978) dacarthes two. types of intermediaries: 


At “academic intermediaries" whose responsibility is.to synthesize and 
° Yd 
“translate. research into useable forms a (2) “research bgokeve” who locate, 
« = . x ? 
ae i aa and represent Findings to policy: makers. 
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cid * . . * 
- These awe themes and the, issues of en.tight ment versus Sage P q 


. and Barer versus transaction establish four basic strategies for im- 0 


2° -5 


. Oe proving the use of feSea rater, palicy making (See Figure ys enlighten- 


4 Trentstransfer, Sfglaeer nae EPuae ree: OT SNES ROE ORE transaction, and en~ 


eo . iv “ 
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gineering-transaction: vit should be stressed that ‘these four strategies 


. ~ 


are ideal ee. ors a are cerneented in the literature in their 
, :" : ee ‘ 


 * 


Poa cat 


~ pure"! form, -whi'Je.otherss are not. . a ; = 
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: Sieber (1972) ine fies several wilanned change i besine and as- 
sesses their efficiency in promoting #nnovations in terms of the effort 
required to carry them out, thet coverage of the bépul akban of change 
targets, and their yie¥d (the number of barewtexehe actually adopt the ' 
innovation). The most- éf ficient strategies are defined as those that re-~ 
quire minimal effort, enable wide coverage, and havea high yield. A 


similar analysis can be conducted for the four research utilization: strate- 


gies. In this case, effort refers to that which researchers must put forth. 


] 


to enact the strategy, the population of targets is policy makers, and 


yield is the probability that policy makers will take research into account 


on 


in policy formulation. 

Enlightenment=transfer strategies emphasize the one-way communi cation 
of basic research. This strategy assumes that policy makers actively seek 
information (to the extent that they read fdurnabe; attend lectures, or 
watch films) and are able to translate abstract generalizations into 
specific weGlone appropriate for concrete situations. The effort to enact 


this strategy is low because researchers have to do no more than they are | 


J 


accustomed to doing to put the strategy into action: conducting .research 


v 
and writing. Cove rage of the population of policy makers is high for two 


reasons. One isSthat the use of mass media widens the audience that can be 


reached, and the other-is that because basic research often addresses gen- 


eric concerns that cut across specific policy fields, it has the poten- 


$ 
u 


‘tial for use by a variety of policy makers. However, the yield of this 


strategy. is low. Policy makers are subject to considerable time con- 


straints’ to make decisions. Time constraints interfere with the ex- 


tent to which information caf be processed, especially that which is ‘not 


? Be re 
~ immediately relevant to policy-makers! needs. Without the availability 


of someone to translate findings into a form which has meaning for a & 
$ F F ‘ 2 ‘ ’ * 
specific situation, it is probable that this function wiJl not be per- 
fornted, In addition, policy makers receive considerable political pres- 


s 


sure from their constituents, special interest groups, ‘and peers to make 
particular decisions. ‘This pressure often inhibits the use of research 
even when the application of the research is, readily apparent. The com- : 
bination of low effort, high coverage, and low yield make this strategy 
Say coderbely efficient in promoting the use of research. 
The use of research focused on a specific problem increases fhe yield 
e - a 
.ofF the engineering-transfer strategy beyond that of enlightenment-transfer. : z 
Engineering-transfer assumes that the policy maker is an active informations 
seeker, but the information the policy maker obtains is in a form much more’ 
a, 0 relevant to particular policy issues. However,. because the time and polit- 
- —. ical constraints mentioned with the enlightenment-transfer strategy also. 
apply in this case, the yield is only moderate. It is probably the 
x on that the more specific the problem for which information is supplied, 
the narrower the audience to which it is useful. Thus, problem-focused 
research somewhat offsets the wide eooeraue Atfarded by the use ot mas» 
media. As was, the case aah the previous strategy, effort is low. 
Thus, the low effort required coupled with the moderate yield and moderate = 


. : 4 ad 
coverage also make this strategy only moderately efficient. : 


‘ 


i 4 . 
The énlightenment-transaction strategy enables the policy maker to 
be a lesS active tnformation seeker. _Instead, either the researcher and 
the policy maker discuss research ahead of. the time it may be needed.or--a 


research broker brings important findings to the policy-maker's attention. 


? 


The effort to enact such a strategy'is considerably higher than the trans- . 
. . : i ’ ; @ 
fer strategies. First, not only must researchers perform their usual duties 


but also they must identify and hold conversations with particular audiences 


~ * 


for their research. With basic research these conversations would-essen- 


tially be lobbying sessions in-which researchers attempt to convince policy 
! a ° 


a 


makers of the relevance of the research to policy issues, such as currently 
takes place when researchers are called before congressional committees as 
witnesses. Second, the strategy Saute the inclusion of .another actor in 
the teeecak to policy process. Florio et al. (1979) and Weiss (1978) note 
* that a formal Spranaedant such as this exists only in a few situations at 


present. Thus, an elaborate network of researchers, brokers , and policy 


- 
e 
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. rs a i : - . 
makers would have to be established at’national and local -levels before : 


; 


this aspect of the enlightenment-transaction strategy could be implemented. 
The possibility of wide application to a variety of policy areas repre- 


sented by the use of basic research is more than offset by the limitat*ons 


. - o 


imposed by the.requirement of face-to-face interaction. Thus, unless a 
large number of. brokers were available, coverage is moderate at best. i 


Increasing the involvement of policy makers in discussions about re- 
Q ¢ 2 \ 
search and the use of intermediaries has the potential for high yield. 


However, the time and political pressures mentioned earlier would be no 


less a factor if this instance. This plus, the abstract nature of the re- 


search involved reduces the yield to moderate levels. The combination 


4 
“of high effort and only moderate coverage and yield make this strategy less 


effictent than the first two. er 


The engineering-transaction strategy incorporates the use of _ applied 


research with’ either researcher-policy maker interaction or broker-policy 


’ 


_ ers and policy makers would likely involve the policy makers? assisting 


. 
. * . 
Lo : i. . 
od 
. 


maker interaction. . Although the broker would perform a similar function 
. ° . oe 


as described in the previous strategy, the conversations between reseafch- 
Ss ae . b ‘ . 


with the design of the research to be conducted, at least in defining the 
: - : *, 


research problem. As a result, nis strategy has the best possibility for 


e 


insuring that research is ‘itpecki vsepalteetle to policy concerns and for «+ 


v 


having a high yield, even when ‘constraints on the policy maker are taken 
oa. = ne 


. 


into account. However, the strategy also has its drawbacks, It would re- ° 


quire a high level of effort to be enacted (on the part of both researchers 
and poficy makers) gand its coverage would be less than enlightenment-trans- 


action because the research would be relevant to only a very narrow audi- 
- » : 


ence. Overall, then, this strategy is no more efficient than enlighten- 
ment-transaction and less than the two transfer strategies. 
7 
The above analysis, if accurate, produces at least thgee surprising 


conclusions. One, although the yield of strategies involving applied re- 


@ ‘ 


search is higher than those énvolving basic research, theif efficiency 


is.not. Consequently, arguments about which kind of research is more 


» 


likely to be used in policy making take on tempest-in-a-teapot overtones. 
Two, the strategies which Have the highest yield, the transaction strat 


egies, are only moderately efficient. Three, despite all the attén- ' 
tion.the literature gives to increasing the use of research in.policy 


4 


making, the immediate prospects for achieving this end are modest indeed. . 


Based on these conclusions, qualitative resggychers interested in * 


‘ 
* 


“having their research incorporated into policy would be best advised to 


use either of the. two transfer strategies and concentrate on improving 
\ 


the kind and form of information they present. This: recommendaticn assumes 


° 
-7- ro 
. . 
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that the qualitative researcher sMks as broad an impact as possible; 


“e 


given the time-consuming data coll®ction and analysis methods used in 


t - 


4 ; qualitative research, these methods are not Aikely to be very cost> 


f 
4 Po 


efficient when only a very narrow impact is sought. Of course, opportun-' 
ities. to discuss research with policy makers should: not be_passed up, but 
it is unlikely that researchers have the resources Po ggnerion as, brokers. 


. The extent to which this’ function ‘is pertotied will depend on .the efforts 


is of brokers already iff place, such as project monitors at the National ‘ 
5 - be soa . “ . 


, 
= kg ‘ 5 . bs) . * 
Institute of Education, congressional committee planniing and analysis 


staff, or local Jinking agents. In the..long run, radical’ changes: in the 


ee 
. 


structure of knowledge diffusion networks .have to be made for research ‘to . 


become a powerful policy, tool (Weiss, 1978); however, in the shor€ run, 


~ 


. . researchers can improve the likélihood of their research being used by 


focusing on how to present data in a form useable by brokers and policy 
makers. It is this‘ghort-run, moderately efficient strategy that, the 


ad it ‘ . 
remainder of this paper elaborates.. mo Eee oe 


e Qualitative Research and the Knewledge Needs of Policy Makers 


aos 


Policy makers receive information from a variety of sources other 


oe a 


thdn research, such as personal experience, constituents, ‘and special 


ro 


‘ , 


4 nbelns realty valuable than others from ie Berepert lye of policy, makers y 


. 


qualitative data must successfully meet aonetieesbis and, often contraz’ y 


. 4 ~ 


dictory knowledge needs. In this sect ion we argue that what data are 


fepotted and-how they are package Gat make at least modest contri bu- 


tions to achiguing this end. We conclude the discussion with ra Vist of .- 


- o~ . Ey x 
e/ 6, < 
7 ; ° 


interest groups. To compete with these sources, none oft which are more , — 
0 


. @ 


ad 
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_ guidelines which would seem ‘to-make the ‘reporting of qualitative research 


more suitable for use by policy makers. S 
An initial caveat is flecessary. Much of the literature Geoa anien ; 
“this discussion is based assumes that the dobbeyaidket is an Operative in 
the federal government. The’ reader should keep in mihd that state school 
ae és ees : 
officers, school superintentents, principals, and teachers also have policy 
responsibilities on less global, although no less significant, problems. 
\ For simplicity's sake, this discussion does not attempt to distinguish 


f ie te me 
between policy achens tone oes and knowledge needs unique to those posi- + 


‘ 


tions. However, it is pfobable that individuals in different organizations 


¢ 
* 


and in different positions within those organizations have somewhat vary- * 


ing knowledge needs (Abt Associates, 1978). i 5 cee 


Pott cy makers live in particularly harried worlds. Decisions often 


o 
. 


must be. made before complete information is available, and when it is, 


' * ‘ 


there .is time to digest only the most terse presentations of it. -To 


improve the likelThood that: researgh will be used, Weiss (1978: 69) sug- 


* ° 


- gests simply. writing bettef as one way: ''The classic injunctions are: soda 


start a report’with a brief summary of the ‘eenutes. Seeld jargon, write. 
: graceful prose, use -charts, maps, and other attractive graphics, inter- 
pret the meaning of statistical statements, and write in terms that have 
ipatiae to-the/policy audience." These same thames’ of brevity and ine) 
creased clarity ne commonly found ia other dtscusstans of olicy makers’ . 3 
knowledge needs (Florio et al., 1979; Strike, 19794). . : t 
7 The reporting of qualitative research is more saccessful at being 
: = 7 
clear than it is brief. Primarily because quali'tative data require fewer 


*esoteric analysis* strategies, their presentation does not rely on technical ' 


e . 


explanations that a lay audience cannot understand intuitively. However, 
invol vegtheoretical explanations and elaborations also pose obstacles t to 
the slartty of a research report. This does not mean that researdh for 
policy use should be atheoretical but rather that most policy makers do 
not head to follow the intellectual history of a study to make use of its 
FUT ngs 5 

Ethnographies and case studies are notorius for their length. This 
is mostly a function of the researcher s attempt to provide a holistic 
representation Swarup interpretation of a large\chunk of reality. However, 
long reports hinder a policy maker's use of it. Yo attain brevity Mulhauser 
_ (1974) suggests that the researchér focus on a emaller segment of reality ‘ 
to explore holistically. As an alternative, the case study authors in ~ ee 
Herriott and Gross (1979) selectively pursue specific themes within a 
particular ee of Be Le Either method can effectively reduce the 
researcher! s Buti and does not seem too contradictory to any standards 
of practice in qualitative research. 

Policy makers’ seem nore likely td use Ses if Tt addresses the 
specific problems for which they seek solutions. Although the problems 
school personne! fee are Highline limited than er of occupants 
of regional ‘and national age? Chews.” Mulhauser (1974) argues that rarely 
do any policy makers make comprehensive decisions. Thus, to be useful 
research should address relatively circumscribed problems that fit with Hyg 
current and anticipated policy concerns. This issue of defining the goals 
of research is the one which most clearly separates basic from applied 


educational researchers and engenders the most vehement debate. However, 


what proponents of cither viewpoint frequently overlook is that the issue 


-10- 


of tailoring research to an audience is as nuch.a problem of research re-~ 
porting as it is research definition. Researchers of either*kind can .' 
select which data they choose to report to a particular audience depending 


. 


upon the concerns of that audience. 

Not:only do policy makers need infonnaviga which i cacely whdeweees 
their policy areas but also they need information grounded in the sontexts 
» of the situations for which they make policy. (Sundquist, 1978). Schubert 
(1980: 20) drgues that ''The subject matter of inhuiRy moet include spec- 


ail 


ifics, information that cannot be generalized to other situations, but is 
essential for moving toward desirable personnel and social Keeetunions of 
donee in, the situation at hand.'' In other, words; information on spec- 

Ape Gites a eae is-more-easity trans lated—into-action- 
than abstracted generalizations. Qualitative research is particularly 
suited to provide this kind of knowledge because it is able to yield 
‘detailed narratives of events witch Gontey their intracacies and meanings’ 
to research users (Eisner, 1979; House, 1979; Schubert, 1980). 

Weiss (1378) and Florio et al. (1979) discuss a knowledge need some- 
wHat antithetical to the above: the need for syntheses of findings. fi 
other words, at the same time that policy makers require information on 
specific eee they also need information about the consistency of the 
Ginabies, The combined weight of findings from several studies ci a 
single study of several contexts is more compelling that findings of a 
single study of?’a single context, especially-styce the policy maker is 
probably unaware of falaved studies which support or contradict a piece 
of research. This need can be fulfilled partially by research brokers 


who compile reviews of the literature on particular-topics. Qualitative 


ae 


14 


researchers can help in two ways: by comparing their findings to those of 
»imilar studies and by engaging in studies of multiple sites such oe 

‘ scribed in Herriott and Gross (1979) er.Crain (1968).° The former way 
places the research in the context of a larger frame of reference; the 
latter enables the researcher to retain the ability to focus on the dynam- 
ics of concrete situations while at the same time increasing the power of 
the findings. As Rist (1980: 9) iotes, "Combi ning deat led analysis with 
the generalized ability. available from multiple sites is an important : 

advance and one those in the policy arena have been quick to capitalize . . 
upon.!! | 


2 
Finally, policy makers are most interested in research which, leads 


easily to specific, unambiguous recommendations for action (Weiss, 1978; 
Florio et al., 1979). This is perhaps the most difficult need for quali- 
tative research to meet. Detailed data from complex situations do not 
easily lend themselves to simple interpretations. The problem of trans- | 
lating such research into action is eaueuaalee vihen the results are from 

a single setting, and thus, differences in settings Sie may affect these 
actions are not known. The use of multiple sites would seem to lessen 

the ambiguity some by xia) bay pesGanEheus to specify better the condi- 
éiuoe under which particular events are likely to lead to other events. 

In addition, narrowing the focus of the data reported would reduce rhe 
number of contingencies which a conclusion would have to address. Simpli- 
fying conclusions.may be distasteful to researchers who pride themselves 


on developing elaborate explanations of complex phenomena, but the policy 


maker is forced to be: less concerned with developing a broad, understanding 


‘ 


of such phenomena than with making the most reasonable decision possible 


given the time constraiats within which the decision has to be made. 
a) ~ « ‘ e 

a ry \ 
Based on the above discussion, qualitative research does not seem ’ 


inherently incompatible with the knowledge needs of policy makers. In- 
deed, in several instances, the kind of data such research yields seems to 
be particularly vakuable. The bulk of the incompatibility resides in how 


the data are reported. To alleviate some of this incompatibility, we pra- 


pose the following guidelines for determining what kinds of data to report 


and how to report them for policy use: 
@ match the focus of the gata reported to the concerns of 


articular policy makers (as much as possible bring policy 


. + \ 
makers into discussions about what their concerns are). ! 


e@ Provide descriptions of the interplay of variables affecting 
“an event, but only if they properly fall within this focus. 
e be as brief as possible, and avoid detailed technical 
discussions (e.g., methodological, statistical, or theor- 
etical) to improve the clarity of the report to lay 
audiences. ‘ 
@ compare the findings to those yielded by sini tae studies. 
@ draw conclusions which are most directly eave to 
establishing appropriate courses of action. 


@ when possible, use a multiple site approach rather than a 


. single case, study. 
It is perhaps presumptuous to suqgest quidelines in an area of re- 
¥ 
search noted for its lack of conformity to any conventions in its com- 


munication of results (Lofland, 1974). However, at the risk of appearing 


r 
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~ 


. even more oresumptuous, what follows is a descriptiow of an attempt to 
e a 


. 


take some of these quidelines into account i a qualitative study of 


¢ gy 
~ school change. 
8 


Constructing a Case Study for Policy Makers , 

Miles (1979) observes that the literature on qualitative research 
ieihuile aiyes infrequent attention idadesceiptians. oF what field workers 
do with their data once*collected. To remedy this oversight somewhat, 
we provide an'example of an attempt to enact the enlightenment-transfer 
strategy. The example is Reena work in Research for Better Schools! 
(RBS) Field Studies Component using cthanaraptis or qualitative methods 
to examine factors that promote intentional a ee of schools. We 
‘will describe the research and its intended audiences, the design and 


analysis strategies, the reporting structure, and the extent to which we 


met the criteria described above. ° 


The Research Project j : 


Since 1978, the three components of RBS' Development Division have 


been developing approaches that agencies such as state departments 0 
education, public euexeienat service agencies (ESAs), or private consult- 
ing firms could use to help schools rprave specific curriculum programs. 
These approaches consist of materials and procedures that an external ° 

"linking agent'' can use, with 4a school's assistance, to diagnose problems 
? and to design customized innovations. Because of the¥failure of previous 
federal policies designed to promote reform through curriculum develop- 


. ment and diffusion (Welch, 1979), the approaches are intended to address 


the general policy question of.what voluntary means can be used to pro- 


& mote school reform. . : 


After initial interr + development, the components began trying out - 


the approaches by offering its assistance, through linking agents, to 
schools. Long-term relationships were established with 12 schools and 
one district (where three schools were involved)... RBS' Field Studies : 
: ‘ ry 
Component had the task of studying the change process as it occurred at 
11 of the sites. The objectives of this research were: 
e To understand the dynamic process of change at the local 


, 2 level (as this process takes place when a school works with 


an outside agency). 


@ To understand the characteristics of schools that can r 
facilitate or hinder the change process. 
@ To understand the characteristics of an externa] agency ‘ 
-(in this bene the RBS conponent groups) that can facilitate 
a Se Br hinder the process. 
e To identify the outcomes of the process. i 
3 | , (Field Studies, 1979: 26) : ; 
To meet ieee research objectives, ethnographic techniques were used. 
Heaviest emphasis was placed on‘direct, nonparticipant observation of 
events saichus place in the schools and informal interviewing of sarttete . 


a 
“ 
. 


pants. j m 
The research was designed to serve the needs of a variety of audiences 
ia f i ie he : 
- which’included other researchers, decision makers within RBS, staff of , 


agencies providing assistance to schools, and federal’ policy makers. 


Because of the wide range of knowledge needs represented in this. list, 


, . 


natch linia the focus of the data to thé concerns of particular policy makers : 

was particularly problematic. For example, consider the problems. in pro- 

viding information just -to a single organization, RBS. At least the in- 

dividuals involved and their concerns were known, but these encerne ware 

very diverse. The Executive Director and corporate fanaoement team wanted 

Geteuiticr sie would guide decisions about the general direction of the an 

corporation, component directors sought information that would help them 7 

finely tune their approaches, and linkers wanted assistance in Working ‘i a Re 

with individual sites more effectively. Moreover, individuals at each 7 

level believed that the Field Studies reports would be used by policy 

makers in and out of RBS to make decisions that would affect the continua- 

tion of their detivity. ; . % | ‘ 
Outside és corporation, e needs of policy makers were even more , ee 

diverse. This diversity might have been reduced scneuilak if the policy 


issues to be addressed were.conte t specific--i.e., how to improve basic 


KJ 
skills instruction or’career preparation programs. However., the research 


a 


addressed a policy issue of interest across—many.areas: °How does one 
13 


assist the change process? Hence; it was very, difficult to focus on .s 


“ 


specific concerns of:any one group. % 


Design and Analysis. if | aie - : : 


While the ability to address specific policy concerns was limited 


by the number of audiences, several factors helped to avoid two problems 


e 


that inhibit poli¢y makers' use of research associated with many ethno- 
graphic studies: the single site approach and the emphasis on holistic 


» 


description of a large piece of reality. For instance, the components 


-16- 


“worked in a number of locations, and this forced us to adopt a multi-site 

design. The number df sites reduced our ability to do the holistic, in- 

depth description associated with ethnographic research. Instead, we opted 

to focus on more specific problems within the sites. The structure of the 
components! work ‘and our research prablems provided ways to detersthe where 

to observe and what questions to ask. In working with a school, each com- 

ponent formed.a teen) planitag team which would meet with the linker -and : 
follow the procedures that were brought from RBS. Since most of the . 
"change process'' took place within these Sai they were the focus of 
observation; most intemviewnng was with team members and RBS linkers. At a 
various times we also’ looked at the social organization of the school, the 

nature of the approaches, and the role of .the ‘RBS linkers, but always to 

determine how they facilitated or impeded the change effort. In this case, 

a problem focus replaced the goal of holistic description as a criterion 


‘guiding data collection. . : 7 


_For some qualitative researchers, the case study is the ultimate 


ethnographic analysis. We made use of this mode, but it was supplemented . 


by intentional efforts to use qualitative materials to make cross-site n= 
comparisons. The case studies were intended to provide both researchers 


and audiences with a ''feel" for the events being analyzed. Essentially 


q 


; : : % 
the cases were to perform this function in three ways. First, they would 


provide an understanding of the process of change; the sequences of ,évents, 
and the extent to which those events were patterned. Second, they would 
promote an understanding of the contexts within which that process occurred, 


especially in the. schools. Third, they would help identify the meanings 


.various participants attached to the contexts ,and process. ~ . - 


~ Py Pct 


Because case studies of all eleven sites walt have been tedious to 
read or write, only three were written.- To keep them within manageable 


size limits, a set of guidelines was developed to focus the studies. Each 


¢ 


case was written by the field worker for the site, and a common outline was 
followed. This outline had five parts: an introduction providing back- 


ground on the site, a recruitment sectdon describing how the site was 


selected, a description of the change process at the site, a description = 


of the outcomes of the process, and conclusions that could be drawn from 


the site. All case studies were less than 10 pages long. 


re) 


e 


In our analysis, the case studies were used in conjunction with an 
examination of relationships among variables across all eleven sites. The 


cross-site analysis was guided by ffeld work which identified a number of 


outcomes of interest and "hunches'' about characteristics of the process. and 
‘ p 


° 


the schoo] context’.that, might affect those outcomes. All field data from . 7% 
af s 
each site were reviewed, and an effort was made to rate each site on 'var- 


iables'' derived from the hunches: Once the rating was completed, simple 
p 


bi-variate epopsntabutetiens were run.to see if process or context charac- 
teristics were associated with outcomes. . 

) This simple approach proved quite powerful. Some of our initial 
hunches were disconfirmed. However, some of the conclusions from the case 


‘studies were supported and, as a result, were shown to be of bfoader gen- 


4 
> 


eralizability than single cases would have Suggested. Thus, the case 


study data suggested variables for the cross-site analysis, captured the : 


Se, 4 


complexity of events at the sites, and, in some cases, indicated why there 


. « . 4 . 
weré.certain relationships between variables; reciprocally, the cross-site 


bo 3 


afee ’ 


ty 


5 


analysis helped indicate that findings from the case studies were not 


flukes. 


Reporting 


Perhaps the most important aspect of our reporting strategy was that 
a variety of reports were written. Somewhat different strategies were’ 


used for internal and external audiences. i 


The internal strategy was governed by the requirement that we{ share 


a . , 
reports with the components to ensure factual correctness and the belief 
4 


that most people at RBS would not read more than one report from us. As 
a result, we produced a single report summarizing our findings. This re- 
port included a literature review that was a combination of a review of 


theories relevaht to our problem and findings of similar studies. It also 


a 


had two features that were not included in later reports: a moderately 


detailed description of. the approaches followed by each component and a 
set of recommendations. External reviewers of the report argued that the 
approaches were similar enough that a detailed analysis would not interest 


outside readers, but it was of use to RBS' management team. 


« 


In addition to a written report, Field Studies made itself available 


4 


for discussion of the report. For instance, the Field Siudfes Coordinator 
attended a meeting to discuss the implications of the report for future 


directions of the corporation. Here his role was limited to answering 


questions and providing clarification, The effort to apply findings and 


descriptions to corporate issues was made by top managers. 


‘ 


* # ; 
Externally, three different reports were prepared. _The first report 


“ 


was a 119 page report of all data and analyses (Firestone and Corbett, 


as 


Vy a 4 


“N 


/ 


~ 


1979). While this report was geared mostly to researchers, it was sent 
to project monitors in st hineon: Since these monitors were supposed . 
to act as brokers between researchers and policy makers, we hoped the 
work would enter the stream of studies synthesized for policy makers. 
_The~second report was 30 pages long. It identified a central policy 
issue to which the study was relevant: the usefulness of linking agents 


in promoting, change and factors that.can limit such usefulness (Firestone 


‘. and. Corbett, 1980). This report was directed to both researchers and 


policy makers although the primary dissemination, channels likely led it 


to researchers (e.g., a reading at an educational research conference, a 
. 7 


presentation to members of dissemination of research projects, and sub- 


mission to a journal that we believed was .read by some policy makers as 


° 


vell as researchers). 


Finally, and perhaps most important, a two-page report in the form 


- - 


~ of a press-release was written by the corporation's public relations 


office. This release summarized the findings without nresencing any data. 


3 


It was sent to linkers and program managers in State capacity-building 
' \ 


programs around the country. . 
: ‘ ; 
. One problem facing researchers who wish to see their research incor- 
"4 e i 
porated into policy decisions is the lack of clear indications of such - 


use. Certainly, we received no such evidence. However, we can assess 
. ’ 


the probabi lity. of our success by determining how close we éame to meeting 


the guidelines for reporting qualitative research identified above. 


: ® 5 
@ Match the focus of: the data reported to the concerns of 
> 
particular policy ‘makers. , 


# 
: . ’ 


-20- 


Qa 
. 
. 


Our conscious effort to produce a variety of reports and 


include different materials for internal and external 
- ; ; ci ae Ridge 

audiences was an important step in the right direction, 

but the plethora of policy-making audiences we could 


address and our interest in writing for. researchers as 
a 3 


well as policy makers limited our effectiveness. In 


addition the .dissemination channels needed to reach the 
two audiences were probably very different. We were much 
; 


more familiar with ways to reach researchers. 


° 


_Provide descriptions of the interplay of variables affecting 


an event only if they properly fall within this focus. 


« 


The decisions to write short case studies, to leave the 


. 


case studies out of shorter reports, and to gear all 


data presentations to a problem of interest to policy 
, * , 
makers led to parsimonious description. However, with _ 


. 


the exception af the press release, it is doubtful that © 


, bolicy makers. read the descriptions provided. Research 


. 


brokers, however, probably did. re 
Be_as brief as possible and avoid technical discussions. 
. 5 ° s 


In the longer paper, we did present a literature ‘review. 
This was not exceptional ly. theoretical. or abtruse, but 
it did identify precursors to our effort. Even.this was 
probably a too lengthy approach to setting the context 


for the research, 


-2?1- 


rid 


# % ’ 
* So ’ 


- @ Compare: the findings to those yielded by similar studies. 


Except where we described neeeurcorebnd discrepancies 


in findings which jed to our research effort, we did not 
7 4 


compare our findings with those of others. ° To be most 
° ‘ ee | 


useful, such a comparison should have come when our 


findings were presented. 


e Draw conclusions which are most directly related to estab- 
lishing appropriate courses of action. 


This guideline was followed most closely in the draft 
« report shared with RBS where reconmendations for action ~- 
were made: Elsewhere ‘it seemed inappropriate because 


of the plethora of audiences to be addressed and limited ' 


. 


knowledge about them. - 


+ 


e@ When possible, use a multiple site approach. 


The reports wene based on. research conducted in 11 sites, 


This summary suggests that our success was mixed. We probably ad- 


r 


e) 


“vanced over many ethnographic studics in our use of several sites and our | 


ability to limit and focus our descriptions. However, we were not as 
successful jin tying reports direétly. to specifics policy audiences or -in 


locating the proper dissemination channels to reach those audiences. 


) 


CONCLUSION 


& 


In this paper we established a typology of strategies for improving . 
2 3 e a: 


r 


- the use of research in policy making. The typology was based on two 


themes current in the research/knowfedge uti'ization literature: the 


‘kind of research conducted for policy makers and the dissemination of — 9 


° ry 


ar 


‘ erm Fe ee 


s 


ae : 
strategies, we concluded 


ra ~~ & 


gies“which emphasize matching the data reported through mass media to the 


lines for qual tative researehers to use to improve this.match and provided 


. a 2 


: . ‘ + *e ‘ . 
an example pf an attempt to follow ‘the guidelines. » The discussion. of this 


cal = . . : ‘ 
example revealed additional dgfficulries inherent in the research-to-.° 


.- 
. 


policy process. 


_ vthan modest, progress toward this, end. 


\- 


, wee Y ‘ 
-informatior# needs of particular audiences. 


er 


cad 


‘ 


After examining the ef ficienty of LDGSE 


"of ‘isk strategies available to 


‘that researchers ard not likely to achieve more 


ieee te od \ 
m1 Ene, the ones. which are the most efficient aré hienitadan transfer strate- 


“We identified a set of guide- 


SY 


x 


: ‘ 
. 


a 


- 
. 


Although we predict modest success fae re use of sresearch ‘in policy 


* 
~ s 


’ 


formulation, this state. of affairs sail not eat srscourage 


researchers. 


notes, most of the resistance to researth use derives Fro the ifterplay 


of forces within this realm: 


contributions actually should be Seana eal naniwe 


“Thes 


“ 


fact that 


researchers can make moderate’ 


+, 


* 


The world of policy making is complex and, as ‘Weiss (1978), 


ee the most. 


Bias injunction that can be eet qualitative pexanreere'| is to. 


\eari more about the policy-riaking world. 


- 


Not aaty can such knowledge 


policy-making -cycle research will be most useful, 


Currently expectations are high for the potential of qualitative methods 


to have an ‘impact on education. 


research gets into policy, the chances for even minimal success in meet- 


ing: these expectations are sma 


% 


to whom the research 


Should be directed, and what are the appropriate dissemination channels. 


Without careful consideration of how . 


o 


. 


_ improve the kind of reports written, but also it can- suggest when in the’ | 


4 


e 
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Figure 1: Four Strategies for Improving Research Use in Policy Making 


